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(57) ABSTRACT 

An optical disk system is presented which incorporates 
computer graphics rendering capability to create and display 
three-dimensional (3-D) objects synchronized with 3-D 
sound. The optical disk system includes an audio/video 
(A/V) decoder coupled to a microprocessor and a rendering 
unit. The A/V decoder and the microprocessor receive a 
bitstream including encoded video and audio data, 3-D 
presentation data, and navigation data. The 3-D presentation 
data includes object and audio modeling data, and may also 
include instructions executed by the microprocessor in order 
to perform an operation upon the object and audio modeling 
data. The object modeling data includes data pertaining to an 
object to be displayed upon a display device, and the audio 
modeling data includes data pertaining to sound to be 
produced by multiple speakers. The bitstream may be a 
DVD -compliant bitstream having an sub-picture unit (SPU) 
portion, and the 3-D presentation data may be conveyed 
using the SPU portion of the bitstream. The A/V decoder 
stores decoded video and audio data within an A/V memory 
unit. The microprocessor stores the 3-D presentation data 
within a 3-D memory unit. The rendering unit retrieves the 
object modeling data from the 3-D memory unit, performs 
a rendering function (e.g., a shading operation) upon the 
object modeling data producing image data, and stores the 
image data within the A/V memory unit. The A/V decoder 
retrieves the decoded video and image data from the A/V 
memory unit and provides the decoded video and image data 
to the display device. 

43 Claims, 6 Drawing Sheets 
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OPTICAL DISK SYSTEM INCORPORATING be three dimensional. For example, a rendering technique 

COMPUTER GRAPHICS RENDERING may first model the objects as frameworks of straight lines 

CAPABILITY TO CREATE AND DISPLAY connected to form outlines (i.e., wireframe models). Por- 

TH REE-DIMENSIONAL (3-D) OBJECTS lions of the lines which would not be visible to a viewer may 

SYNCHRONIZED WITH 3-D SOUND 5 then be removed. Such "hidden line removal" makes the 

objects appear solid. Color and texture may then be attrib- 
BACKGROUND OF THE INVENTION uted to surfaces of the objects. One or more light sources 

may be defined, and one of various shading techniques may 

1. Field of the Invention be emp i 0 yed to make the objects appear more realistic. 
This invention relates to optical disk systems, and in 10 Optical disks (e.g., DVDs and laser video disks) now have 

particular to an optical disk system including three- the capacity to store enough video and audio data to recreate 

dimensional (3-D) graphics and sound capability. hours of movmg and synchronized sound. Existing 

2. Description of the Related Art optical disk technology is inadequate, however, to allow 
Optical disks are recording media which typically contain limitless movement through a virtual environment created 

long strings of microscopic pits representing digitally 15 by the moving images and sound. For example, encoding 
encoded data. Each string of pits is called a "track". The every possible permutation of a joystick used to navigate 
tracks are formed end to end in a spiral pattern around the through the virtual environment would require too much 
center of one or both major surfaces of the disk. Reflected storage space. In addition, current optical disk technology 
laser light is used to "read" the data encoded in the pits. does not support the creation and display of 3-D objects at 
Common types of optical disks available today include 20 speeds possible using dedicated hardware employing corn- 
compact disks (CDs), laser video disks, and digital versatile puter graphics rendering techniques, 
disks (DVDs). Various optical disk players are available it would be beneficial to have an optical disk system 
reading data from optical disks. which incorporates computer graphics rendering capability 
Laser video disks and DVDs have storage capacities in order to create three-dimensional (3-D) objects synchro- 
which exceed those of normal CDs, and are capable of 25 nized with 3-D sound. Such an optical disk system would 
storing full length movies and other presentations including allow limitless navigation through a virtual environment, 
video and audio information. A digitized version of a full and would be useful for flight simulation, virtual tours of 
length movie includes an enormous amount of digital video planned structures and historic buildings, games, etc. 
data. In order to reduce the amount of digital video data 

which must be stored, the digital video data is typically 30 SUMMARY OF THE INVENTION 
compressed and encoded according to a Moving Pictures problems outlined above are in large part solved by 
Experts Group (MPEG) standard (e.g., MPEG-2). MPEG-2 an optical disk system which incorporates computer graph- 
compression removes redundant information (e.g., informa- ics ren( jering capability to create and display objects which 
tion relating to areas of images that don't change) and ^ appear to be three dimensional and synchronized 3-D sound, 
information not readily perceived by a viewer. The audio opt i ca i disk system includes an audio/video decoder, a 
content of the movie is typically digitized, compressed, and microprocessor, and a rendering unit. The audio/video 
encoded according to either a Dolby® AC-3™ or MPEG decoder receives a serial train or stream of bits (i.e., a 
audio standard. bitstream) including encoded video and audio data, 3-D 

The current DVD standard is a compromise format agreed 40 presentation data, and navigation data. The encoded video 

upon by several major consumer electronic and entertain- and audio data may be encoded using an MPEG standard 

ment companies. Under the current DVD standard, the (e.g., MPEG-2). The 3-D presentation data includes object 

capacity of a single side, single layer DVD with a diameter modeling data and audio modeling data. The object model- 

of 4.7 inches is 4.7 gigabytes, enough to store about 135 ing data includes data pertaining to an object to be displayed 

minutes of MPEG-2 video data. This capacity is sufficient 45 upon a display device, and may include coordinate locations 

for about 95% of all full length movies. The current DVD of pairs of points which define straight lines used to model 

standard also provides for up to eight different sound tracks the object. The audio modeling data includes data pertaining 

in different languages. In addition, up to 32 different sets of to sound to be produced by multiple speakers. The bitstream 

subtitles may be stored on a DVD for display during may be a DVD-compliant bitstream having an sub-picture 

playback, 50 unit (SPU) portion. The 3-D presentation data may be 

Data retrieved from a spinning DVD by a DVD drive is conveyed using the SPU portion of the bitstream. 

typically conveyed as a data stream including compressed The audio/video decoder obtains the encoded video data 

video and audio "substreams". The DVD standard also from the bitstream, decodes the encoded video data thereby 

allows for an optional "navigation" substream to be included producing decoded video data, and stores the decoded video 

in the data stream. The navigation substream specifies ways 55 data in an audio/video memory unit coupled to the audio/ 

in which a DVD system user can interact with the multi- video decoder. The microprocessor also receives the 

media presentation. Inclusion of the navigation substream bitstream, obtains the 3-D presentation data and the navi- 

allows the multimedia presentation to become an interactive gation data from the bitstream, and stores the 3-D presen- 

experience, allowing sequences of video and audio data to tation data in a 3-D memory unit coupled to the micropro- 

be assembled according to user input. For example, the 60 cessor, 

navigation substream allows a user to choose which path to The microprocessor executes software instructions which 

take in a given video scene. ma y be stored in a microprocessor memory unit coupled to 

Various interactive computer programs (e.g., games) exist the microprocessor. The 3-D presentation data may also 

which create the perception of movement through a virtual include instructions executed by the microprocessor in order 

environment. The virtual environment typically includes 65 to perform an operation upon the 3-D presentation data. In 
images of objects and sounds. Many of these programs . this case, the microprocessor stores the instructions within 

employ rendering techniques to make the objects appear to the microprocessor memory unit. 
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The navigation data defines a set of optional next decoder may retrieve decoded video data from the decoded 

sequences of encoded video data, 3-D presentation data, and video portion of the frame buffer and image data from the 

navigation data to be included in the bitstream. An input sub-picture portion of the frame buffer, and produce the 

device may be opcrably coupled to the microprocessor and video output signal by superimposing the image data upon 

may produce an output signal in response to user input. The 5 mc decoded video data. 

microprocessor may produce control signals in response to The optical disk system may include a disk drive unit for 

the navigation data and/or the output signal. The control retrieving the encoded video and audio data, the 3-D pre- 

signals may be used to select a member of the set of optional « ntation data, and the navigation data from an optical dtsk 

next sequences of encoded video data, 3-D presentation » ; DV ?)- ™* disk drive unit may provide die bitstream 

, , j . t . , , , n including the encoded video and audio data, the 3-D pre- 

data, and navigation data. 10 m M<£ d*t*, and the navigation data to the audio/video 

The microprocessor is also coupled to the audio/video decoder and the microprocessor, 

memory unit. The microprocessor may retrieve the object ^ ^ dfive may be capable of both retrieving data 

modeling data from the 3-D memory unit, perform a graph- from ^ sloriQg daU a « recordable ~ optical disk . ^ 

ics function upon the object modeling data thereby produc- optical disk system may operate in a playback mode and a 

ing image data, and store the image data within the audio/ " record mode ^ optjcal disk system fe in the pUy . 

video memory unit. The microprocessor may also retrieve back modC) ±c disk ^ uml rctricvcs cnC oded video and 

the audio modeling data from the 3-D memory unit, perform audio ^ 3 _ D presentation data> and navigation data from 

an audio function upon the object modeling data thereby ^ ^ ^ ^ dcscribcd abovc> In the p i aybac k mode, 

producing 3-D audio data, and store the 3-D audio data ^ microprocessor mntro]& the operation of the disk drive 

within the audio/video memory unit. unit in response to the navigation data. When the optical disk 

The rendering unit is coupled to the microprocessor, the system is in the record mode, the audio/video decoder 

3-D memory unit, and the audio/video memory unit. The retrieves decoded video data and image data from the 

rendering unit retrieves the object modeling data from the audio/video memory unit, encodes the decoded video data 

3-D memory unit, performs a rendering function upon the and me image data thereby producing encoded video and 

object modeling data thereby producing image data, and image data, and provides the encoded video and image data 

stores the image data within the audio/video memory unit. t0 tne disk drive unit. The disk drive unit stores the encoded 

The rendering function may include, for example, a shading v i dco and j ma gc data upon the recordable optical disk 

operation performed upon the object modeling data. The audio/video decoder may encode the decoded video 

shading operation may add the color black to a base color of ^ dala and the data in acc0 rdance with an MPEG 

a portion of the object, wherein the quantity of the color standard (e.g., MPEG-2) and provide the resulting encoded 

black added is in inversely proportional to the amount of video and image data t0 tne ^ dr j ve unit as a bitstream. 

illumination the portion receives from a light source. For examp i ej tne bitstream may be a DVD-compliant bit- 

The 3-D presentation data may be conveyed as a data stream including a sub-picture unit (SPU) portion, and the 

packet having a header portion including the length of the 3S image data may be conveyed using the SPU portion of the 

data packet and a data portion including the 3-D presentation bitstream. 

data. The object is to be displayed within a window defined described above, the audio/video memory unit may 
within the boundaries of a display screen of the display include a frame buffer portion. In the record mode, the 
device. The data packet may further include a control audio/video decoder may retrieve the decoded video data 
portion which defines the size and location of the window. 4Q and me image data from the frame buffer portion. The frame 
Alternately, user input via the input device may select the buffer portion may include a decoded video portion and a 
size and location of the window. An on-screen display sub -picture portion. The audioMdeo decoder may retrieve 
(OSD) unit within the audio/video decoder may be coupled lne decoded video data from the decoded video portion and 
to the microprocessor and operably coupled to the display t he image data from the sub-picture portion, 
device. The OSD unit may cause a textual message to be DDTCC nccrDIimriv , nc TOC no au/impc 
displayed upon the display device in response to a control 45 BRIEF DESCRIPTION OF THE DRAWINGS 
signal from the microprocessor. The textual message may Other objects and advantages of the invention will 
prompt the user to select the size and location of the window become apparent upon reading the following detailed 
via the input device. The output signal of the input device description and upon reference to the accompanying draw- 
may be used to determine the size and location of the 5Q ings in which: 

window. FIG. 1 is a block diagram of one embodiment of an optical 

The object is displayed by superimposing the object upon disk system in accordance with the present invention, 

a background image displayed upon the display screen of the wherein the optical disk system includes an audio/video 

display device. The audio/video memory unit may include a decoder coupled to an audio/video memory unit; 

frame buffer portion, and the audio/video decoder' may store 55 FIG. 2 is a diagram of a DVD-compliant serial train of bits 

the decoded video data in the frame buffer portion. The (i.e., bitstream) including an SPU portion, wherein the SPU 

rendering unit may also store the image data within the portion is a grouping or "packet" of data having a data 

frame buffer such that the image data overwrites decoded portion, a header portion, and a control portion; 

video data stored within the frame buffer by the audioMdeo FIG. 3 is a block diagram of one embodiment of the 

decoder. The audioMdeo decoder may retrieve data from the 60 audioMdeo decoder of FIG. 1, wherein the audioMdeo 

frame buffer portion of the audioMdeo memory unit and decoder includes a decoder, a sub-picture unit (SPU), and a 

provide the data as a video output signal. display controller, and wherein the display controller 

Alternately, the frame buffer portion may include a includes an on-screen display (OSD) unit which superim- 

decoded video portion and a sub-picture portion. The audio/ poses image data (e.g., textual messages or "menus") upon 

video decoder may store the decoded video data in the 65 "background" display data; 

decoded video portion, and the rendering unit may store the FIG. 4a is a perspective view of a wireframe model of an 

image data within the sub -picture portion. The audioMdeo object, wherein the object is modeled as a collection of 
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adjacent fiat surfaces having three or more straight line the decoded video and audio data. Audio/video decoder 14 

edges, and wherein each edge of the object is represented by provides the decoded video data to a video signal encoder 

a straight line between two "comer" points; 18, and provides the decoded audio data to an audio digital 

FIG. 4b is a perspective view of the object of FIG. 4a to analog converter (DAQ 20. A suitable audio/video 

following bidden line removal; 5 decoder is the model L64020 source decoder (LSI Logic, 

FIG. 4c is a perspective view of the object of FIG. 46 Milpitas, Calif.), 

following the fixing of the position of a light source relative Optical disk system 10 also includes a microprocessor 

to the object and a subsequent shadowing operation; C"P) 22 which controls the operations of the various com- 

F1G. 5 is a block diagram of one embodiment of the P°°™ts of °pdcal disk system 10. Microprocessor 22 

audio/video memory unit of FIG. 1, wherein the audio/video 10 executes software instructions stored within a microproces- 

memory unit includes a frame buffer portion for storing *or &*) memorv UIut 24 c0U P led to microprocessor 22. For 

decoded video data and an audio buffer portion for storing example, microprocessor 22 may execute instructions of a 

decoded audio data; and real ^ operating system (RTOS) stored within micropro- 

, . . , , j. c ,i- , f4 . r a cessor memory unit 24. Microprocessor 22 may also execute 

FIG. 6 is a block diagram of one embodiment of the frame / .^^^^..^^ .n.hjn 
. ^ . , . - .j ■> e n^. * 15 instructions of 3-D application software stored within micro- 
buffer portion of the audio/video memory unit of FIG. 5, r K A , , - . - n • 

wherein the frame buffer portion includes a decoded video P rocessor memor y umt 24 > formm S a 3 " D engme • 

portion for storing decoded video data and a sub-picture Microprocessor 22 receives the bitstrcam produced by 

portion for storing image data. drive unit 12 *»* ob,ains 3 ' D P^nUtxoa data and 

While the invention is susceptible to various modifica- M * 6 navigation data from the b.tetrearn. As described above 

tions and alternative forms, specific embodiments thereof the 3-D pr^ematmn data mducles object modehng dau and 

are show by way of example in the drawings and will audio modeling dafc. Microprocessor 22 stores the object 

herein be described in detail It should be understood, modehng data and the audaomodelmg data m a 3-D memory 

however, that the drawings and detailed description thereto ™» 26 coupled to microprocessor 22. Microprocessor 22 

are not intended to limit the invention to the particular form „ subsequently retrieve the object modelmg daU from 

disclosed, but on the contrary, the intention is to cover all " 3 " D memory umt 2«, perform a graphics function upon the 

modificat ons )e qmvalen te andalterna(i V esfallingwithinthe ° b J ec < modelmgdata producing mtermediate or final image 

spirit and scopcof the present invention as defined by the and store lh f T 1 ^^^^^"^ 

j j I • 3-D memory unit 26. Similarly, microprocessor 22 may 

appen e c aims. subsequently retrieve the audio modeling data from 3-D 

DETAILED DESCRIPTION OF THE 30 memory unit 26, perform an audio function upon the audio 

IrWENTION modeling data producing intermediate or final 3-D audio 

„^ „ . L1 t data, and store the intermediate or final 3-D audio data 

Referring now to the drawings, FIG. 1 is a block diagram 3 D me ^ 2(j 

of one embodiment of an optical disk system 10 in accor- _^ e . . 

j ... .... ^ t >Li a;*\, e„o^ m m „ Microprocessor 22 may, for example, execute at least a 

dance with the present invention. Optical disk system 10 35 . v c . 0 , . . J \. „ . x ; ' „ ft , maxt 

*ij j-ij* *nf *„~sA*a »\a** portion of the x86 instruction set. Microprocessor 22 may 

includes a disk drive umt 12 for retrieving encoded video . . . , ,^ , . ( . 

j j * j » • t. j- . wi^™™^*™^^-, also include, for example, hardware necessary to support the 

and audio data, three-dimensional (3-D) presentation data, ' . a 4 w VM \ „, „ Q( f f„ ct „^ 

* • »■ j . , j M i ^.cb -n,*. multimedia extension (MMX™) superset of the x8o lnstruc- 
and navigation data stored upon an optical disk. Ine A , , x . *%<* « a 
, , B " j , JL. u 0 «L ^.mX iK^ r^ci.it rtf lion set. Alternately, microprocessor 22 may execute soft- 
encoded video data may be for ^^ ^^ f war e which emulates hardware execution of MMX™ 
1*11^^ ?? 7 MPEG standard (e g., 40 instructions MMX ™ instructions accelerale multimedia 

MPEG-2). The encoded audio data may be, for example, the '"7™ / . „. rn/l<1 „ nf ^ m4U 

result of encoding in accordance with the Dolby® AC-3™ communications compulations M^i^ 22miy 

or MPEG audio standard. THe 3-D presentation data may als u ° be configured to execute i m tru^nsnot included m 

include, for example, object modeling data and audio mod- eito the x86 '~ 00 f or lhe superse . 

eling data. Ine object modeling data may include data 45 ^ 3 * D Presentation data may also include software 

pertaining to one or more objects to be displayed upon a instructions to be executed by microprocessor 22 in order to 

display device, and the audio modeling data may include display the object or generate 3-D sound. Microprocessor 22 

data pertaining to sound to be produced by two or more stores such instructions within microprocessor memory unit 

speakers. The optical disk may be placed within a designated 24, and subsequently retrieves and executes the instructions, 

area of a horizontal platform which slides in and out of disk 50 Opucal disk system 10 also includes a rendering unit 28 

drive unit 12. Alternately, disk drive unit 12 may have a slot coupled to microprocessor 22 and 3-D memory unit 26. 

for insertion of the optical disk. Disk drive unit 12 produces Microprocessor 22 controls the operations of rendering unit 

a serial stream or train of bits (i.c., a bitstrcam) which 28. Rendering unit 28 retrieves object modehng data from ■ 

includes the encoded video and audio data, the 3-D presen- 3-D memory unit 26 and performs a rendering function upon 

tation data, and the navigation data. 55 the object modeling data in order to produce image data. 

Optical disk system 10 also includes an audio/video Rendering unit 28 may also retrieve intermediate image data 

decoder 14 which receives the bitstream produced by disk produced by microprocessor 22 from 3-D memory umt 26 

drive unit 12, obtains the encoded video and audio data from *nd perform a rendering function upon the intermediate 

the bitstream, and decodes the encoded video and audio data image data, thereby producing final image data. As will be 

thereby producing decoded video and audio data. Audio/ 60 described in detail below, the rendering function adds a 3-D 

video decoder 14 stores the decoded video data in a frame quality to images created using the image data. Rendenng 

buffer portion of an audio/video memory unit 16 coupled to unit 28 stores the image data within audio/video memory 

audio/video decoder 14. Audio/video decoder 14 also stores unit 16. 

the decoded audio data in an audio buffer portion of audio/ Optical disk system 10 also includes an input device 30 

video memory unit 16. Audio/video decoder 14 subse- 65 coupled to microprocessor 22. Input device 30 produces an 

quently retrieves decoded video data from the frame buffer output signal in response to a user input. Input device 30 

and decoded audio from the audio buffer and synchronizes may be, for example, a mouse, a joystick, or a keyboard. The 
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coupling between input device 30 and microprocessor 22 video and audio data within audio/video memory unit 16. 

may include one or more electrical conductors (i.e., wires), SPU 50 also receives the DVD-compliant bitstream pro- 

or the coupling may be wireless (e.g., via radio or infra-red duced by disk drive unit 12, obtains SPU data from the SPU 

light waves). Input device 30 may include a keypad having portion of the bitstream, and stores the SPU data within 

multiple pressure -activated electrical switches (i.e., keys). 5 audio/video memory unit 16. Display controller 52 retrieves 

As described above, microprocessor 22 obtains navigation data from audio/video memory unit 16 and provides display 

data from the bitstream produced by disk drive unit 12. The data to video signal encoder 18. Display controller 52 

navigation data defines a set of optional next sequences of includes a on-screen display (OSD) unit 54. OSD unit 54 

encoded video data, encoded audio data, 3-D presentation superimposes image data (e.g., textual messages or 

data, and navigation data to be included in the bitstream. 1Q "menus") upon "background" display data. OSD unit 54 is 

Microprocessor 22 selects a member of the set of locations coupled to microprocessor 22 and operates in response to 

of optional next sequences of encoded video data, 3-D control signals from microprocessor 22. Following the dis- 

presentation data, and navigation data by producing a con- play of a textual message or menu, the output signal of input 

trol signal dependent upon the navigation data and the device 30 may be used to configure playback of a 3-D 

output signal produced by input device 30. Disk drive unit 5 presentation. For example, the output signal may be used to 

12 receives the control signal and responds in order to select the size and location of the window used for display 

provide the selected next sequences of encoded video data, of the object (i.e., playback of the 3-D presentation). When 

3-D presentation data, and navigation data. the 3-D presentation is a game, the output signal may be 

Optical disk system 10 also includes two or more speakers used to select difficulty (i.e., skill) level, and may also be 

32 coupled to audio DAC 20 and a display device 34 M used to select whether input device 30 is a joystick, a 

coupled to video signal encoder 18. Audio DAC 20 receives keyboard, etc. 

digital audio data produced by audio/video decoder 14 and FIGS. 4a-c will now be used to describe how the ren- 

produces an analog audio signal. The analog audio signal is dering function adds a 3-D quality to an image of an object 

coupled to speakers 32. Speakers 32 convert the electrical created from the 3-D presentation data. The first step in a 

energy of the analog audio signal into sound energy. Display ^ rendering process may be to model the object as a collection 

device 34 may be, for example, a television. Video signal of adjacent flat surfaces having three or more straight line 

encoder 18 receives the digital video data produced by edges, forming a "wireframe" model of the object. FIG. 4a 

audio/video decoder 14 and produces an analog video is a perspective view of a wireframe model of an object 60. 

signal, preferably according to a recognized standard tele- Each edge of object 60 is represented by a straight line 

vision broadcast format (e.g., national television system 30 between two "corner" points. For example, in FIG. 4a, one 

committee or NTSC, phase alternate line or PAL, etc.). The edge of object 60 is represented by a straight line 66 between 

analog video signal is coupled to display device 34. Display a pair of points 62 and 64. The orientation of straight line 66 

device 34 creates an image upon a display screen of display is determined by the locations of points 62 and 64, and the 

• device 34 dependent upon the analog video signal. locations of points 62 and 64 are fixed by their coordinates. 

The optical disk may be, for example, a DVD, and the 35 Thus the 3-D presentation data may include coordinate 

bitstream produced by disk drive unit 12 may be a DVD- locations of pairs of points which define straight lines used 

compliant bitstream having a sub-picture unit (SPU) portion. to model the object. 

The SPU portion of a DVD-compliant bitstream is used to The next step in a rendering process may be to remove 

convey graphical image data (e.g., textual characters) to be portions of the straight lines which would not be visible to 

displayed by superimposing the graphical image data upon 40 a viewer (i.e., "hidden line removal"). FIG. 4b is a perspec- 

a background image. The 3-D presentation data may be tive view of object 60 following hidden line removal. The 

conveyed using the SPU portion of the bitstream. In other hidden line removal operation helps make object 60 appear 

words, 3-D presentation data and 3-D graphics software may solid. 

be mapped to the SPU syntax of a DVD-compliant bitstream Following hidden line removal, a shading operation may 

and "streamed" into optical disk system 10. For example, the 45 be performed to make the image appear more realistic and 

current SPU header syntax includes an unused "PES_ lifelike. The position of a light source (i.e., a source of 

priority** bit normally set to zero. By setting the PES_ illumination) is fixed relative to the object. Any of several 

priority bit to one, 3-D presentation data may be identified known shading operations (e.g., Gouraud shading, Phong 

and distinguished from normal SPU data. shading, ray tracing, etc.) may then be performed to add the 

FIG. 2 is a diagram of a DVD-compliant bitstream 40 so color black to base colors of each flat surface (i.e., portion) 

including an SPU portion 42. SPU portion 42 is a grouping of the object. The quantity of the color black added is in 

or "packet" of data having a data portion 48, a header portion inversely proportional to the amount of illumination each 

46, and a control portion 44. Header portion 46 includes a portion of the object receives from the light source. FIG. 4c 

value indicating the length of the data packet, and data is a perspective view of object 60 following the fixing of the 

portion 48 includes the 3-D presentation data. The object ss position of a light source 68 relative to object 60 and a 

formed from the 3-D presentation data is to be displayed subsequent shadowing operation. 

within a portion or "window** defined within the boundaries The display and sound generation operations of optical 

of the display screen of display device 34. Control portion disk system 10 will now be described. FIG. 5 is a block 

44 of the SPU data packet may define the size and location diagram of one embodiment of audio/video memory unit 16, 

of the window as well as a display start time. 60 wherein audio/video memory unit 16 includes a frame buffer 

FIG. 3 is a block diagram of one embodiment of audio/ portion 70 and an audio buffer portion 72. Audio/video 

video decoder 14 including a decoder 49, a sub-picture unit decoder 14 stores decoded video data in frame buffer portion 

(SPU) 50, and a display controller 52. Decoder 49 receives 70 and decoded audio data in audio buffer 72. Rendering 

the DVD -compliant bitstream produced by disk drive unit unit 28 may store produced image data within frame buffer 

12, obtains the encoded video and audio data from the 65 portion 70 such that the image data overwrites the decoded 

bitstream, decodes the encoded video and audio data pro- video data stored within frame buffer portion 70 by audio/ 

ducing decoded video and audio data; and stores the decoded video decoder 14. Audio/video decoder 14 retrieves video 



04/16/2004, EAST version: 1.4.1 



US 6,442,331 Bl 

9 10 

data from frame buffer portion 70, retrieves audio data from coupled to the audio/video decoder, wherein the bit- 
audio buffer portion 72, synchronizes the video and audio stream is a DVD-compliant bitstream having an sub- 
data, provides the video data to video signal encoder 18, and picture unit (SPU) portion, and wherein the 3-D pre- 
provides the audio data to audio DAC 20. sentation data is conveyed using the SPU portion of the 
When the optical disk is a DVD disk and the bitstream 5 bitstream; 

a a u jvn i ' ^ . „ nwn „ Amn |- n , a microprocessor coupled to receive the bitstream and 

produced by cask drive unit 12 is a DW-comph nt oon ^ md to obtair f the 3 . D prcsC ntation data and the 

bitstream, opUcd disk system 10 may take advantage of the n ^ zli on data from the bitstream, store the 3-D pre- 

display capabilities afforded by the SPU portion of the da(fl m & ^ memQry ^ ^ M tQ ^ 

DVD-comphant bitstream. FIG. 6 is a block diagram of one microprocessor, and produce a control signal in 

embodiment of frame buffer portion 70 of audio/video 10 response t0 me navigation data; and 

memory unit 16, wherein frame buffer portion 70 includes a a rendering unit l0 me microprocessor, the 3-D 

decoded video portion 74 and a sub-picture portion 76. memory unit, and the audio/video memory unit, 

Audio/video decoder 14 stores decoded video data in wherein the rendering unit is configured to retrieve the 

decoded video portion 74 of frame buffer portion 70. Ren- object modeling data from the 3-D memory unit and to 

dering unit 28 may store produced image data within sub- 15 perform a rendering function upon the object modeling 

picture portion 76 of frame buffer portion 70. Audio/video data thereby producing image data, 

decoder 14 may retrieve video data from both decoded video 2. The optical disk system as recited in claim 1, wherein 

portion 74 and sub-picture portion 76 of frame buffer portion the optical disk system further comprises a display device 

70, superimpose the video data from sub-picture portion 76 operably coupled to the audio/video decoder, and wherein 
upon the video data from decoded video portion 74, and 20 the object modeling data includes data pertaining to an 
provide the resultant video data to video signal encoder 18. . object to be displayed upon the display device. 

Disk drive unit 12 may be able to both retrieve data from u 3 ™° s y ste A m « recited m claim }> w 1 h t erein f 

and store data upon a "recordable" optical disk, and optical °P Ucal ^ ^ ^^^tti f 

disk system 10 may operate in a playback mode or a record s P K eakers °P era * * °° U P ed * ^ audio/video decoder, and 

a wl , e , e ^ m in L ; n <uo „u„k„m, mr ,H„ 25 wherein the audio modeling data includes data pertaining to 

mode. When optical disk system 10 is in the playback mode, £ , , rtf 

j- i a * -.n . • a a 'An n „A- n A«t« sound to be produced by the plurality of speakers, 

disk drive unit 12 retrieves encoded video and audio data, . _ K . t J , r . j . , . - u 

" n , ;. , , , . , ,„ f ^„ t . n1 4. The optical disk system as recited in claim 1, wherein 

3-D presentation data, and navigation data from the optical . r . 7 . . , . , . 

j- i j -uju t.u iui a • « the rendering function includes a shading operation per- 

disk as described above. In the playback mode, micropro- 6 & 

i-i . 1 ,u J j . „ ■ formed upon the object modeling data, 

cesser 22 controls the opeuUoa of disk dnve unn 12 ,n 1^^, d ^ svstem as recited in claim 4, wherein 

response to the navigation daU When opt.c.l d^k sys4em 10 P ^ coiQr a base ^ Qf 

* u. the record mode, audio/video decoder " a portion of the object, and wherein the quantity of the color 

decoded video data and image data from audio/video , f , .... . . , , ,/ , Af 

. _ , . Jf , . . , At nwtA iVio black added is in inversely proportional to the amount of 

memory urn 16 encodes the decoded video dala and the mummation (he rtion ^fj from a light source . 

image data thereby producing encoded video and image ^ ^ ^ 

data, and provides fee encoded v,deo and image data to disk £ ^ coordinate locations of 

dnve unit 12. Audio/video decoder 14 may convey the J f 

encoded video and image data to the disk dnve unit as a s" 

bitstream For example the bitstream may be a DVD- 0 . ^ j wherem 

compliant b.Utream including a sub-picture uni (SPU) ^crop^essor is coupled to the audio/video memory 

portion, and the image data may be conveyed using the SPU . . * t v . ^ 

T 7u u ■ f n /i, ^™ 11 ft^c th^ unit, and wherein the microprocessor is further configured to 

portion of the bitstream. Disk dnve unit 12 stores the ' ^J^„f, flmt k.in m ™n,n;. 

j j • j * * , . # • i j * i» retrieve the object model mg data from the 3-D memory unit, 

encoded video and image data upon the optical disk. A t , . t * • . j •• 

& ^ r to perform a graphics function upon the object modeling 

As described above, audio/video memory unit 16 may daU lhereby producing i^ge data, and -to store the image 
include a frame buffer portion 70. In the record mode, 45 data within mc audio/vidco mcmor y unit, 

audio/video decoder 14 retrieves the decoded video data and g ^ opUcal disk syslem ^ recUed in claim x wnerein 

the image data from frame buffer portion 70. Frame buffer thc m i croproC essor is coupled to the audio/video memory 

portion 70 may include a decoded video portion 74 and a unil> an d wherein the microprocessor is further configured to 

sub-picture portion 76. Audio/video decoder 14 may retrieve retrieve the audio modeling data from the 3-D memory unit,- 
the decoded video data from decoded video portion 74 and 5Q tQ perform ^ audio function upon the object modeling data 

the image data from sub-picture portion 76. thereby producing 3-D audio data, and to store the 3-D audio 

Numerous variations and modifications will become da t a within the audio/video memory unit, 
apparent to those skilled in the art once the above disclosure 9 xh e optical disk system as recited in claim 1, wherein 
is fully appreciated. It is intended that the following claims th e 3.9 presentation data includes instructions executed by 
be interpreted to embrace all such variations and modifica- 55 the microprocessor in order to perform the graphics func- 
tions, tion. 

What is claimed is: 10. The optical disk system as recited in claim 1, wherein 

1. An optical disk system, comprising: the 3-D presentation data includes instructions executed by 

an audio/video decoder coupled to receive a bitstream the microprocessor in order to perform the audio function, 
including encoded video data, three-dimensional (3-D) 60 11. The optical disk system as recited in claim 2, wherein 

presentation data, and navigation data, wherein the 3-D the 3-D presentation data is conveyed as a data packet 

presentation data includes object modeling data and having a header portion including the length of the data 

audio modeling data, and wherein the audio/video packet and a data portion including the 3-D presentation 

decoder is configured to obtain the encoded video data data. 

from the bitstream, decode the encoded video data 65 12. The optical disk system as recited in claim 11, wherein 

thereby producing decoded video data, and store the the object is to be displayed within a window defined within 

decoded video data in an audio/video memory unit the boundaries of a display screen of the display device. 
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13. The optical disk system as recited in claim 12, further sub-picture unit (SPU) portion, and wherein the 3-D 
comprising an input device operably coupled to the micro- presentation data is conveyed using the SPU portion of 
processor and configured to produce an output signal in the bitstream; 

response to a user input, and wherein the audio/video an audio/video decoder coupled to receive the encoded 

decoder comprises an on-screen display unit coupled to the s video data from the disk drive unit and configured to 

microprocessor and operably coupled to the display device, decode the encoded video data thereby producing 

and wherein the on-screen display unit is configured to cause decoded video data, and to store the decoded video data 

a textual message to be displayed upon the display device in in an audio/video memory unit coupled to the audio/ 

response to a control signal from the microprocessor, and video decoder; 

wherein the output signal of the input device is used to io a microprocessor coupled to receive the 3-D presentation 

determine the size and location of the window. data and the navigation data from the disk drive unit 

14. The optical disk system as recited in claim 12, wherein and configured to store the 3-D presentation data in a 
the data packet further includes a control portion, and 3-D memory unit coupled to the microprocessor, and to 
wherein the control portion defines the size and location of control the operation of the disk drive unit in response 
the window. 15 to the navigation data; and 

15. The optical disk system as recited in claim 12, wherein a rendering unit coupled to the microprocessor, the 3-D 
the object is displayed by superimposing the object upon a memory unit, and the audio/video memory unit, 
background image displayed upon the display screen of the wherein the rendering unit is configured to retrieve the 
display device. 3-D presentation data from the 3-D memory unit and to 

16. The optical disk system as recited in claim 1, wherein 20 perform a rendering function upon the 3-D presentation 
the bitstream comprises a serial train of bits. data thereby producing image data. 

17. The optical disk system as recited in claim 1, wherein 25. The optical disk system as recited in claim 24, wherein 
the navigation data defines a set of optional next sequences the optical disk is a DVD. 

of encoded video data, 3-D presentation data, and navigation 26. The optical disk system as recited in claim 24, wherein 

data to be included in the bitstream. 25 the 3-D presentation data includes data pertaining to an 

18. The optical disk system as recited in claim 17, further object to be displayed upon a display device, 
comprising an input device operably coupled to the micro- 27. The optical disk system as recited in claim 24, wherein 
processor and configured to produce an output signal in the 3-D presentation data includes instructions and data 
response to a user input, wherein the microprocessor pro- executed by the microprocessor in order to display the 
duces the control signal in response to the output signal, and 30 object. 

wherein the control signal selects a member of the set of 28. The optical disk system as recited in claim 22, wherein 

optional next sequences of encoded video data, 3-D presen- the 3-D presentation data is conveyed as a data packet 

tation data, and navigation data. having a header portion including the length of the data 

19. The optical disk system as recited in claim 1, whereio packet, a data portion including the 3-D presentation data, 
the audio/video memory unit includes a frame buffer 35 and a control portion. 

portion, and wherein the audio/video decoder stores the 29. The optical disk system as recited in claim 28, wherein 

decoded video data in the frame buffer portion. the object is to be displayed within a window defined within 

20. The optical disk system as recited in claim 19, wherein the boundaries of a display screen of a display device, and 
the frame buffer portion includes a decoded video portion wherein the control portion of the data packet defines the 
and a sub-picture portion, and wherein the audio /video 40 size and location of the window and a display start time, 
decoder stores the decoded video data in the decoded video 30. The optical disk system as recited in claim 29, wherein 
portion, and wherein the rendering unit is further configured the object is displayed by superimposing the object upon a 
to store the image data within the sub-picture portion. background image displayed upon the display screen of the 

21 . The optical disk system as recited in claim 20, wherein display device. 

the audio/video decoder is further configured to retrieve 45 31. The optical disk system as recited in claim 24, wherein 

decoded video data from the decoded video portion of the the navigation data defines a set of locations of optional next 

frame buffer and image data from the sub-picture portion of sequences of encoded video data, 3-D presentation data, and 

the frame buffer, and wherein the audio/video decoder is navigation data to be retrieved from the optical disk, 

further configured to produce a video output signal by 32. The optical disk system as recited in claim 31, further 

superimposing the image data upon the decoded video data. 50 comprising an input device operably coupled to the micro - 

22. The optical disk system as recited in claim 19, wherein processor and configured to produce an output signal in 
the rendering unit is further configured to store the image response to a user input, wherein the microprocessor selects 
data within the frame buffer such that the image data a member of the set of locations of optional next sequences 
overwrites decoded video data stored within the frame buffer of encoded video data, 3-D presentation data, and navigation 
by the audio/video decoder, and wherein the audio/video 55 data dependent upon the output signal. 

decoder is further configured to retrieve data from the frame 33. The optical disk system as recited in claim 24, wherein 

buffer portion of the audio/video memory unit and to provide the audio/video memory unit includes a frame buffer 

the data as a video output signal. portion, and wherein the audio/video decoder stores the 

23. The optical disk system as recited in claim 1, wherein decoded video data in the frame buffer portion. 

the encoded video data is encoded using the MPEG-2 60 34. The optical disk system as recited in claim 33, wherein 

standard. frame buffer portion includes a decoded video portion and a 

24. An optical disk system, comprising: sub-picture portion, and wherein the audio/video decoder 
a disk drive unit for retrieving encoded video data, 3-D stores the decoded video data in the decoded video portion, 

presentation data, and navigation data stored upon an and wherein the rendering unit is further configured to store 

optical disk, wherein the disk drive unit produces the 65 the image data within the sub -picture portion, 

encoded video data, 3-D presentation data, and navi- 35. The optical disk system as recited in claim 34, wherein 

gation data as a DVD -compliant bitstream having an the audio/video decoder is further configured to retrieve 
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decoded video data from the decoded video portion of the 
frame buffer and image data from the sub-picture portion of 
the frame buffer, and wherein the audio/video decoder is 
further configured to produce a video output signal by 
superimposing the image data upon the decoded video data. 

36. The optical disk system as recited in claim 33, wherein 
the rendering unit is further configured to store the image 
data within the frame buffer such that the image data 
overwrites decoded video data stored within the frame buffer 
by the audio/video decoder, and wherein the audio/video 
decoder is further configured to retrieve data from the frame 
buffer portion of the audio/video memory unit and to provide 
the data as a video output signal. 

37. An optical disk system, comprising: 

a disk drive unit for retrieving data from and storing data 

upon an optical disk; 
a 3-D memory unit for storing data; 
an audio/video memory unit for storing data, wherein the 
audio/video memory unit includes a frame buffer 
portion, and wherein when the optical disk system is in 
the playback mode the audio/video decoder stores the 
decoded video data in the frame buffer portion, and 
wherein when the optical disk system is in the record 
mode the audio/video decoder retrieves the decoded 
video data from the frame buffer portion, wherein the 
frame buffer portion includes a decoded video portion 
and a sub -picture portion 
a microprocessor coupled between the disk drive unit and 

the 3-D memory unit; 
an audio/video decoder coupled between the disk drive 

unit and the audio/video memory unit; and 
a rendering unit coupled to the microprocessor, the 3-D 

memory unit, and the audio/video memory unit; 
wherein the optical disk system operates in a playback 
mode and a record mode, and wherein when the optical 
disk system is in the playback mode: 
the disk drive unit retrieves encoded video data, 3-D 
presentation data, and navigation data from an opti- 
cal disk and provides the encoded video data, 3-D 
presentation data, and navigation data; 
the microprocessor receives the 3-D presentation data 
and the navigation data from the disk drive unit and 
stores the 3-D presentation data in the 3-D memory 
unit; 

the audio/video decoder receives the encoded video 
data from the disk drive unit, decodes the encoded 
video data thereby producing decoded video data, 
and stores the decoded video data in the audio/video 
memory unit; 

the audio/video decoder stores the decoded video data 
in the decoded video portion; 

the rendering unit stores the image data within the 
sub-picture portion; and 

the rendering unit retrieves the 3-D presentation data 
from the 3-D memory unit, performs a rendering 
function upon the 3-D presentation data thereby 
producing image data, and stores the image data 
within the audio/video memory unit; and 
wherein when the optical disk system is in the record 

mode: 

the audio/video decoder retrieves decoded video data 
and image data from the audio/video memory unit, 
encodes the decoded video data and the image data 
thereby producing encoded video and image data, 
and provides the encoded video and image data to 
the disk drive unit; 
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the audio/video decoder retrieves the decoded video data 
from the decoded video portion and the image data 
from the sub-picture portion; and 
the disk drive unit stores the encoded video and image 
data upon the optical disk. 

38. The optical disk system as recited in claim 37, wherein 
the optical disk is a recordable DVD. 

39. The optical disk system as recited in claim 37, wherein 
when the optical disk system is in the playback mode the 
microprocessor controls the operation of the disk drive unit 
in response to the navigation data. 

40. The optical disk system as recited in claim 37, wherein 
the 3-D presentation data includes data pertaining to an 
object to be displayed upon a display device. 

41. The optical disk system as recited in claim 37, wherein 
when the optical disk system is in the record mode the 
audio/video decoder conveys the encoded video and image 
data to the disk drive unit as a DVD-compliant bitstream 
including a sub-picture unit (SPU) portion, and wherein the 
image data is conveyed using the SPU portion of the 
bitstream. 

42. An optical disk system, comprising: 

an audio/video decoder coupled to receive a bitstream 
including encoded video data, three-dimensional (3-D) 
presentation data, and navigation data, wherein the 3-D 
presentation data includes object modeling data and 
audio modeling data, and wherein the audio/video 
decoder is configured to obtain the encoded video data 
from the bitstream, decode the encoded video data 
thereby producing decoded video data, and store the 
decoded video data in an audio/video memory unit 
coupled to the audio/video decoder, wherein the navi- 
gation data defines a set of optional next sequences of 
encoded video data, 3-D presentation data, and navi- 
gation data to be included in the bitstream; 

a microprocessor coupled to receive the bitstream and 
configured to obtain the 3-D presentation data and the 
navigation data from the bitstream, store the 3-D pre- 
sentation data in a 3-D memory unit coupled to the 
microprocessor, and produce a control signal in 
response to the navigation data; and 

a rendering unit coupled to the microprocessor, the 3-D 
memory unit, and the audio/video memory unit, 
wherein the rendering unit is configured to retrieve the 
object modeling data from the 3-D memory unit and to 
perform a rendering function upon the object modeling 
data thereby producing image data. 

43. An optical disk system, comprising: 

a disk drive unit for retrieving encoded video data, 3-D 
presentation data, and navigation data stored upon an 
optical disk, wherein the navigation data defines a set 
of locations of optional next sequences of encoded 
video data, 3-D presentation data, and navigation data 
to be retrieved from the optical disk; 

an audio/video decoder coupled to receive the encoded 
video data from the disk drive unit and configured to 
decode the encoded video data thereby producing 
decoded video data, and to store the decoded video data 
in an audio/video memory unit coupled to the audio/ 
video decoder; 

a microprocessor coupled to receive the 3-D presentation 
data and the navigation data from the disk drive unit 
and configured to store the 3-D presentation data in a 
3-D memory unit coupled to the microprocessor, and to 
control the operation of the disk drive unit in response 
to the navigation data; and 
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rendering unit coupled lo the microprocessor, the 3-D perform a rendering function upon the 3-D presentation 

memory unit, and the audio/video memory unit, data thereby producing image data, 
wherein the rendering unit is configured to retrieve the 

3-D presentation data from the 3-D memory unit and to * + + * ♦ 
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